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PREFACE 


Schedule  and  cost  growth  in  DoD  weapon  system  acquisition 
programs  have  seen  recognized  as  an  economic  fact  of  life.  This 
growth  has  been  the  subject  of  many  studies  and  analyses  that 
have  documented  the  phenomenon.  A  variety  of  causal  factors 
have  been  identif:  ^d,  including: 

•  General  economic  inflation 

•  Supply/labor  shortages 

•  Technological  uncertainty 

•  Specification  changes 

•  Changes  in  threat 

•  Budgetary  constraints 

While  it  may  be  interesting  and  informative  to  know  why  growth 
has  occurred,  senior  decisionmakers  need  a  realistic  and  simple- 
to-use  method  whereby  they  can  project  the  probable  cost  of  a 
system  by  the  time  it  has  matured  enough  to  be  placed  in  the 
hands  of  a  using  unit  (i.e.,  by  the  time  the  system  attains  its 
initial  operational  capability). 

This  paper  briefly  outlines  the  weapon  system  acquisition 
cycle  and  the  associated  DoD  management  processes  and  tools. 

Its  purpose  is  to  develop  a  methodology  for  projecting  future 
growth  in  individual  programs.  To  this  end,  a  total  of  thirty- 
seven  major  weapon  system  programs  were  examined  for  schedule 
and  cost  growth.  The  primary  data  source  used  in  this  effort 
was  the  Selected  Acquisition  Report — the  official  quarterly 
report  used  by  the  DoD  to  provide  the  Congress  with  updated 
cost,  schedule,  and  performance  data  on  new  major  acquisition 
programs . 
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Acquisition  programs  were  split  into  four  categories: 
aircraft,  missiles,  ships,  and  other  systems.  Within  each 
category,  individual  weapon  system  schedule  and  cost  growth 
was  documented.  Mean  and  median  factors  were  derived  for 
schedule,  development  cost  and  procurement  unit  cost  growth. 

A  schedule  and  cost  growth  projection  methodology  that  relies 
on  a  simple  charting  technique  was  developed  and  then  explained 
in  a  series  of  sketches  and  examples. 
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I.  INTRODUCTION 

The  actual  costs  of  weapon  systems  are  virtually  always 
much  greater  than  estimates  made  during  their  planning  and 
development  phases.  Accordingly,  in  studies  involving  the 
cost-effectiveness  of  weapon  systems,  current  cost  estimates 
of  systems  net  yet  deployed  should  be  adjusted  to  reflect 
probable  future  cost  growth.  This  adjustment  is  particularly 
important  in  studies  involving  the  relative  costs  and  effec¬ 
tiveness  of  ’weapon  systems  at  different  stages  of  their  life 
cycle.  Use  of  unadjusted  costs  would  tend  to  favor  unfairly 
those  systems  in  earlier  stages  of  development  relative  to 
those  systems  in  later  stages  of  development  or  deployment. 

This  paper  presents  a  methodology  for  making  such  adjustments 
to  current  estimates. 

The  IDA  schedule  and  cost  growth  projection  methodology 
uses  the  Selected  Acquisition  Report  (SAR)  as  its  data  source. 
The  SAR  was  chosen  because  it  is  an  official  report  submitted 
by  the  Office  of  the  Secretary  of  Defense  (OSD)  to  the  Congress 
on  the  status  of  major  acquisition  programs.  The  SAR  is  a 
highly  aggregated  report  which  is  focused  on  the  "bottom-line" 
roll-up  of  a  program's  estimated  acquisition  costs.  It  is  the 
one  DoD  document  most  often  cited  in  Congressional  and  GAO 
reports  dealing  with  cost  growth. 

This  paper  treats  cost  growth  in  weapon  system  acquisition 
programs  as  an  economic  fact  of  life.  It  does  not  address 
operating  and  support  costs  of  a  system  once  the  system  is 
fielded  (deployed).  The  basic  purpose  of  the  paper  is  to  pro¬ 
vide  a  mechanism  whereby  the  potential  for  cost  growth  in  a 


1 


program  can  be  illuminated  and  quantified.  The  methodology  is 
not  a  vehicle  for  explaining  why  growth  occurred.  The  approach 
is  straightforward  and  treats  all  programs  on  an  "other  things 
being  equal"  basis.  As  is  the  case  with  any  estimating  tech¬ 
nique,  the  IDA  growth  projection  methodology  is  not  a  panacea. 
Its  use  is  most  appropriate  where  data,  existing  cost  esti¬ 
mating  relationships,  time  or  resources  are  not  adequate  or 
available  to  complete  an  independent  cost  analysis  of  a  given 
program . 

This  study  was  performed  under  the  IDA  Independent  Research 
program.  Use  of  the  proposed  methodology  in  future  weapon  sys¬ 
tem  studies  and  analyses  is  planned.  This  revision  is  the  first 
update  of  this  paper.  Additional  updates  are  anticipated  when 
other  major  systems  currently  under  development  attain  IOC. 


II.  PAST  STUDIES  OF  COST  GROWTH 


A  literature  search  provides  many  references  to  cost 
growth,  a  few  of  which  are  presented  below. 

A  1 9 7 S  3AC  Report  (Ref.l)  opened  with  the  following: 

7r.  March  27,  179^,  the  Congress  authorized  the 
building  of  six  large  frigates  which  were  to  form 
the  backbone  of  the  U.S.  Navy.  The  then  War  Depart¬ 
ment  was  assigned  the  task  of  acquiring  the  ships. 
Nearly  17  months  later  the  six  keels  were  laid. 

Shortly  thereafter,  due  to  delays  and  cost  overruns, 
the  program  was  cut  back  to  three  frigates. 

Today,  184  years  later,  most  Federal  agencies 
are  faced  with  the  same  problem — ultimate  costs  of 
major  programs  are  often  many  times  the  estimated 
costs  on  which  they  were  approved. 

A  1965  Anser  Memorandum  (Ref. 2)  reported: 

The  incongruity  between  estimated  and  actual 
costs  of  today's  weapon  systems  indicates  a  need 
for  cost  estimates  which  more  accurately  predict 
the  cost  of  future  weapon  systems.  Estimates  made 
near  the  beginning  of  a  development  program  are 
particularly  unreliable.  For  example,  the  cost  of 
developing  11  existing  weapon  systems  was  as  much 
as  seven  times  the  amount  originally  estimated.  A 
study  of  the  development  and  production  costs  of 
33  weapon  systems  showed  that  the  original  cost 
estimates  were  l80  to  220  percent  too  low,  on  the 
average,  even  after  price-level  and  cost-quantity 
adjustments  were  made. 

A  1972  Rand  Paper  by  Alvin  J.  Harman  (Ref. 3)  indicated 
a  continuation  of  cost  growth: 

•Improvement  in  the  process  of  acquiring  major 
weapon  systems  has  been  the  subject  of  analyses  and 
policy  recommendations  for  several  decades  [see,  for 
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example,  Klein  (1962)1,  Peck  and  Scherer  (196C)1, 
Marschak,  et  al.  (  1967)1,  Perry,  et  al .  (1971) U 1  - 
While  system  costs  have  increased  as  weapon  systems 
have  grown  more  complex,  for  programs  of  comparable 
duration  and  technical  difficulty,  the  extent  of 
cost  growth  over  original  estimates  has  not  signif¬ 
icantly  improved  [Harman  (1970) J1. 

A  1965  Rand  Memorandum  (Ref. 4)  noted  that  cost  growth 
also  widely  experienced  in  major  civil  projects. 

Twenty-two  chronologies  of  cost  estimates  of 
major  articles  of  Air  Force  weapon  systems  consti¬ 
tute  the  basic  data  of  this  study.  Even  a  cursory 
examination  of  the  chronologies  suggests  that  the 
estimates  leave  much  to  be  desired.  It  should  be 
recognised,  however,  that  predicting  how  much  some¬ 
thing  will  cost  that  is  to  be  produced  a  long  time 
in  the  future  is  always  a  hazardous  activity.  The 
United  States  is  studded  with  railroads,  canals, 
tunnels,  bridges,  and  highways  that  cost  a  great 
deal  more  than  was  originally  expected.  For  example, 
the  final  cost  of  the  Troy  and  Greenfield  Railroad 
was  more  than  ten  times  as  much  as  the  original 
estimate,  principally  because  tunneling  four  miles 
through  Hoosac  Mountain  turned  out  to  be  enormously 
more  difficult  than  the  railroad's  geologists  had 
predicted.  The  Welland  Canal  cost  many  times  more 
than  was  expected  because  the  height  of  a  major  cut, 
estimated  at  30  feet,  was  actually  60  feet. 

The  Suez  and  Panama  Canals  tell  much  the  same 
story.  Th«  earliest  cost  estimate  for  the  Suez 
Canal,  a  half-century  before  it  was  finally  built, 
was  low  by  a  factor  of  twenty;  the  year  before  dig¬ 
ging  actually  began,  the  estimate  was  still  low  by  a 
factor  of  three.  The  early  abortive  effort  by  the 
French  to  build  a  canal  across  the  Isthmus  of  Panama 
was  undertaken  as  a  result  of  a  substantial  under¬ 
estimate  of  the  magnitude  of  the  task.  The  total 
outlay  on  the  project  by  the  French  and  subsequently 
the  United  States  was  about  twice  what  the  French 
originally  thought  would  be  necessary.  Even  though 
the  United  States  had  the  French  experience  to  learn 
from,  and  a  portion  of  the  Job  was  already  done,  the 
American  outlay  was  70  percent  more  than  anticipated 
when  the  American  work  began. 


See  Harman  reference  list,  p.70. 
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The  nuclear  power  plants  recently  built  offer  an¬ 
other  example.  Almost  without  exception,  the  initial 
cost  estimates  for  these  plants  were  too  low.  Costs 
climbed  from  50  percent  to  100  percent,  and  in  some 
cases  are  still  climbing.  It  is  instructive  to  examine 
the  breakdown  given  by  Consolidated  Edison  for  the  cost 
increases  they  experienced  in  their  Indian  Point  plant. 
Though  the  total  cost  went  up  about  90  percent,  expen¬ 
ditures  on  the  strictly  nuclear  portion  of  the  plant 
went  up  by  a  factor  of  three;  the  increase  for  the  con¬ 
ventional  elements,  on  the  other  hand,  was  only  37  per¬ 
cent.  If  one  allows  for  general  price-level  increases 
and  a  slight  change  in  gross  capacity,  the  increase  for 
the  nuclear  part  of  the  plant  still  amounts  to  a  factor 
of  about  two-and-a-half . 

A  1972  Ph.D  dissertation  (Ref. 5)  included  a  review  of 
the  literature  on  cost  growth  of  weapon  systems. 

The  most  sophisticated  studies  of  actual  cost  per¬ 
formance  on  programs  as  compared  to  original  cost  esti¬ 
mates  were  the  Merton  J.  Peck  and  Frederic  M.  Scherer 
studies1  and  several  Rand  Corporation  studies. 

Peck  and  Scherer  analyzed  twelve  typical  weapon 
systems  programs  of  the  1950' s.  All  twelve  systems 
employed  cost-plus-fixed-fee  contracts.  The  average 
cost  growth  was  found  to  be  220  percent  beyond  origi¬ 
nal  target  cost.2 

Almost  Identical  results  came  from  a  later  study  of 
22  Air  Force  weapon  systems  programs  involving  68  esti¬ 
mates.  The  study,  entitled  Strategy  for  R&D:  Studies 
in  the  Microeconomics  of  Development,  by  Thomas  Marschak, 
Thomas  K.  Glennan,  Jr.,  and  Robert  Summers  of  Rand  Cor¬ 
poration,  shewed  an  average  cost  growth  of  226  percent 
beyond  original  estimated  cost.3  These  programs  also 
entailed  primarily  cost-plus-fixed-fee  contracts  of 
the  late  1950 ' s  . 

In  the  1960's,  incentive  contracts,  rather  than 
cost-plus-fixed-fee  contracts,  were  used  for  most 
engineering  development  efforts.  One  might  therefore 


^rton  J.  Peck  and  Frederic  M.  Scherer,  The  Weapons  Acquisition  Process — 
An  Economic  Analysis  (Boston:  Graduate  School  of  Business,  Harvard  Univer¬ 
sity  (1962). 

2 Ibid.  p.  429- 

3(New  York:  Springer-Verlag  New  York,  Inc.,  1967),  p.  152. 
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expect  actual  program  costs  to  be  closer  to  original 
cost  estimates.  Two  such  studies  of  the  1960's  were 
undertaken  by  Rand  personnel. 

Robert  Perry  et  al .  reported  in  a  study  of  21 
Army,  Navy  and  Air  Force  system  acquisition  programs 
that,  "...[Q]n  average,  cost  estimates  for  the  19o0’s 
were  about  25  percent  less  optimistic  than  those  for 
programs  for  the  1950' 5.  Thus,  if  reduction  in  bias 
(or  reduced  optimism)  is  a  realistic  index  of  "better" 
there  is  evidence  of  improvement  in  the  acquisition 
process."1  Even  such  a  statement  as  this  must  be 
hedged  considerably  as  Perry  et  al.  were  careful  to 
do.  "Still,  the  model  has  little  explanatory  power 
(in  a  statistical  sense),  and  it  does  not  indicate 
why  improvements  have  occurred."2 

In  contrast,  a  more  recent  Rand  follow-up  study 
discounted  any  improvement  in  the  1960's  over  the 
1950 's  noting  that,  "...[F]or  programs  comparable 
in  length  and  difficulty,  19o0's  procurements  would 
have  resulted  in  actual  costs  exceeding  estimates  by 
roughly  the  sarnie  proportion  as  had  1950 's  procure¬ 
ments  .  3 

A  1978  paper  by  Truman  W.  Howard  (Ref. 6)  summarized  the 
results  of  some  other  studies  dealing  with  growth: 

Cost  histories  of  45  systems  under  development 
in  June  1972  showed  that  estimates  one  year  later 
exceeded  development  estimates  by  20  percent  ($19.1 
Billion)  [3]. 4  Such  widely  publicized  overruns  have 
a  severe  impact  on  the  credibility  of  both  Govern¬ 
ment  and  industry  management.  One  case,  the  C-5A 
airplane,  nearly  doubled  its  estimated  unit  cost 
from  $28  to  $55  million  dollars  over  a  five-year 
period  [3]- 4  Such  cost  growth  experience  is  not 
new.  Peck  and  Scherer  [10]4  analyzed  12  weapon  sys¬ 
tem  development  programs  in  the  1950's  and  found 
that  development  costs  averaged  3-2  times  the 

lSystem  Acquisition  Experience,  Memorandum  RM-6072-PR,  prepared  for  United 
States  Air  Force  Project  Rand  (Santa  Monica:  The  Rand  Corporation,  November 
1969),  P.  6. 

2  Ibid. 

3 Alvin  J.  Hannan,  A  Methodology  for  Cost  Factor  Comparison  and  Prediction, 
Memorandum  RM-6269-ARPA,  prepared  for  Advanced  Research  Projects  Agency 
(Santa  Monica:  The  Rand  Corporation,  August  1970),  p.  6. 

‘’See  Hannan  reference  list,  p.  70. 


original  estimate,  and  schedule  slippage  averaged 
I.36  times  the  original  estimate.  Trainor  [12] 1 
in  a  more  recent  study,  analyzed  nine  major  DoD  and 
NASA  development  systems.  Development  costs  aver¬ 
aged  1.31  times  the  original  estimate,  and  schedule 
slippages  averaged  1.6  times  the  original  estimate. 

A  1978  GAO  Report  (Ref. 7)  indicated  pervasive  cost  growth 
for  both  military  and  civil  major  acquisitions: 

The  estimated  costs  of  major  acquisitions  have 
increased  each  year  since  June  30,  1975  >  when  we 
issued  our  first  combined  military  and  civil  major 
acquisitions  status  report  on  585  projects  estimated 
to  cost  $404  billion  at  completion.  The  estimated 
costs  of  857  major  acquisitions  at  September  30,  1978 
have  increased  $49  billion  over  the  past  year  to  more 
than  one-half  trillion  dollars. 

A  report  of  Congressional  hearings  on  DoD  cost  estimates 
conducted  in  1979  (Ref. 8)  concluded: 

The  hearings  focused  on  the  validity  and  overall 
value  of  Department  of  Defense  cost  estimates  given 
Congress  at  two  critical  stages  in  weapon  systems 
procurement — (1)  at  the  initial,  conceptual  stage 
when  a  Planning  Estimate  (PE)  is  made  and  Congress 
has  to  authorize  and  appropriate  the  money  for  a  new 
weapon  system,  and  (2)  at  the  time  full-scale  produc¬ 
tion  [sic]2  funds  are  requested,  when  a  baseline 
Development  Estimate  (DE)  is  given.  The  Planning 
Estimate  and  the  Development  Estimate  were  then  com¬ 
pared  to  the  Current  Estimate  (CE)  that  is  reported 
in  the  quarterly  SAR. 

Since  1969  the  initial  (planning)  estimate  has 
turned  out  to  be  approximately  100  percent  below  the 
actual  costs  of  major  systems.  The  later,  more 
refined  development  cost  estimate  given  Congress 
prior  to  full-scale  development  has  proven  to  be 
approximately  50  percent  below  actual  procurement 
costs . 

The  review  by  the  Subcommittee  failed  to  find 
one  example  where  the  Department  of  Defense  accurately 
estimated  or  overestimated  the  cost  of  any  major 
weapon  system. 


'See  Hannan  reference  list,  p.  70. 

2"Production"  used  incorrectly;  should  have  been  "development." 
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These  excerpts  reveal  a  consistent  and  continuing  pattern 
over  many  years  of  cost  growth  on  both  military  and  civil  major 
acquisitions.  Additional  references  are  included  in  the  list 
of  references. 

Much  has  also  been  written  on  the  causes  of  cost  growth. 
Some  of  the  more  frequently  cited  causes  are: 

"Force  Majeure" 

•  Natural  disaster 

•  Civil  disorder 

•  Labor  strike 

•  Fire 

General  Economic  Inflation 

Cost  estimates  based  on  previous  similar  system  (each 
succeeding  generation  tends  to  cost  more  than  last  generation). 
Supply  shortages 
Labor  shortages 
Poor  management 
Technological  uncertainty 

•  Unknowns 

•  Unknown  unknowns 
Environmental  laws/regulations 
Specification  changes 
Quantity  changes 
Reliability  problems 

Concurrency  (trying  to  produce  too  fast) 

Tight  budgets 
Competitive  environment 

•  within  branch  of  service 

•  within  service 

•  among  services 

•  DoD  vs.  other  federal  agencies 

•  Executive  branch  vs.  Congress 


•  among  contractors 

•  among  individuals 

While  the  above  list  may  not  be  exhaustive,  we  believe 
that  two  causes  must  be  singled  out  because  of  their  impact. 
First  of  all,  we  believe  that  the  competitive  environment  in 
which  weapon  systems  are  developed  is  the  major  factor  leading 
to  cost  growth.  All  weapon  systems  must  compete  for  funds  at 
many  levels  within  the  federal  government.  This  competition 
involves  both  implicit  and  explicit  rankings  of  competing 
systems  on  a  cost-effectiveness  basis.  Effectiveness  usually 
involves  intangible  factors  as  well  as  characteristics  that 
can  be  measured  quantitatively.  However,  cost  is  only  ex¬ 
pressed  in  quantitative  terms.  There  is  an  obvious  incentive 
for  the  proponents  of  a  system  to  underestimate  its  cost  in 
order  to  increase  its  probability  of  acceptance. 

Secondly,  tight  budgets  are  an  often-overlooked  cause  of 
cost  growth.  There  is  a  management  school  of  thought  which 
holds  that  overly-generous  budgets  lead  to  unnecessary  costs. 
This  basic  idea  was  popularized  as  one  of  Professor  Parkinson's 
laws  (Ref . 9) • 

Work  expands  so  as  to  fill  the  time  available  for 
its  completion. 

In  order  to  avoid  this  pitfall,  tight  budgets  (and  schedules) 
are  established  and  so  contribute  to  later  cost  growth.  This 
same  idea  was  discussed  in  a  paper  by  Wayne  Allen  (Ref. 10). 

As  dollars  are  the  most  widely  used  control  mechanism, 
a  practice  of  minimizing  estimates  of  future  costs  has 
evolved  as  a  management  technique  for  attempting  to 
impress  contractors  with  the  continuing  need  to  produce 
more  for  less  and  in  a  shorter  period  of  time. 

And,  in  a  Rand  report  (Ref. 11): 

The  conventional  view  is  that  a  contractor  is  more 
motivated  to  economize  and  to  attempt  to  find  ways 
to  reduce  cost  if  a  development  contract  is  nego¬ 
tiated  for  the  lowest  possible  amount  and  if  the 
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planning  estimate  for  production  items  is  also  low. 

Cost  growth  may  occur,  but  it  is  assumed  that  final 
cost  would  have  been  even  higher  had  the  contractor 
not  been  constrained  by  the  low  early  estimates. 

Although  writers  have  different  opinions  of  the  relative 
importance  of  various  causes  of  cost  growth,  there  is  general 
agreement  that  there  are  a  number  of  contributing  factors, 
and  program  results  almost  invariably  exhibit  resulting  cost 
growth.  Accordingly,  in  Chapter  V  we  present  a  method  by 
which  cost  estimates  of  weapon  systems  in  development  can  be 
adjusted  upward  in  order  to  predict  more  accurately  their 
probable  future  costs  regardless  of  cause. 
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III.  DoD  WEAPON  SYSTEMS  ACQUISITION  MANAGEMENT 
AND  THE  SELECTED  ACQUISITION  REPORTS  (SARs) 


The  continued  schedule  and  cose  growth  experienced  in 
major  weapon  systems  acquisition  programs  is  frequently  cited 
by  critics  of  the  Defense  establishment  as  an  indicator  of 
poor  management  practices.  While  this  statement  is  an  over¬ 
simplification  of  an  extremely  complex  problem,  giver,  the 
various  reasons  for  schedule  and  cost  growth  enumerated  in 
the  previous  chapter,  it  may  be  helpful  to  review  briefly  the 
process  whereby  the  DoD  manages  the  acquisition  of  new  major 
weapon  systems  and  the  reporting  procedures  which  allow 
Congress  to  exercise  its  responsibilities  for  oversight.  A 
familiarity  with  the  management  process  and  reporting  proce¬ 
dures  is  a  prerequisite  to  an  understanding  of  the  growth  pro¬ 
jection  methodology  proposed  in  Chapter  V.  Accordingly,  the 
focus  of  this  chapter  will  be  on  the  Defense  Systems  Acquisi¬ 
tion  Review  Council  (DSARC)  process  and  the  Selected  Acquisi¬ 
tion  Reports.  The  latter  are  the  official  means  employed  by 
the  Department  of  Defense  to  provide  Congress  with  updated 
cost,  schedule,  and  performance  data  on  major  weapon  systems, 
while  the  former  (the  DSARC  process)  provides  the  base  for 
the  data  contained  in  the  SARs. 

A.  THE  MAJOR  SYSTEM  ACQUISITION  PROCESS1 

The  current  major  system  acquisition  process  was  estab¬ 
lished  in  1968  tc  provide  a  means  for  better  managing  the 
acquisition  of  major  systems  (a  major  system  is  any  development 

lrIhis  section  has  been  excerpted  (and  modified)  from  Chapter  A,  .Assistant 
Secretary  of  the  Army  (IL  and  FM)  Report  to  the  Army  Acquisition  Management 
Task  Faroe,  28  November  1979. 
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effort  so  designated  by  the  SECDEF.  Usually,  those  programs 
whose  RDT4E  costs  are  projected  to  exceed  $100  million  or  pro¬ 
curement  costs  are  projected  to  exceed  $500  million  in  FY  3C 
dollars  are  designated  major  programs).  DoD  Directive  5000.1 
and  DoD  Instruction  5000. 2 1  govern  this  process,  which  is  now 
made  up  of  four  phases,  through  which  a  program  normally  pro¬ 
ceeds  before  a  system  is  actually  fielded.  Decision  points 
(or  milestones)  mark  the  entry  into  each  succeeding  phase  of 
the  process. 

At  each  key  decision  point,  top  management  of  the  sponsor¬ 
ing  Service  will  gather  together  in  a  series  of  meetings  cul¬ 
minating  in  a  (Service)  Systems  Acquisition  Review  Council 
(S)SARC  meeting  to  review  all  aspects  of  a  particular  program 
and  its  alternatives.  Recommendations  of  the  (S)SARC  are 
reviewed  and  approved  by  the  Service  Secretary  prior  to  for¬ 
warding  his  decision  on  the  program  to  OSD  for  review.  OSD 
will  then  convene  a  Defense  Systems  Acquisition  Review  Council 
( DSARC)  which  is  chaired  by  the  Defense  Acquisition  Executive 
who  currently  is  the  Under  Secretary  of  Defense  for  Research 
and  Engineering.  The  DSARC  conducts  an  independent  review  of 
the  program  and  makes  its  recommendations  to  the  Secretary  of 
Defense.  SECDEF  approval  is  announced  in  a  Secretary  of 
Defense  Decision  Memorandum  (SDDM)  that  signals  successful 
completion  of  a  milestone  and  Is  authorization  to  proceed 
Into  the  next  phase  of  the  acquisition  cycle. 

The  materiel  acquisition  process  complements  the  DoD 
requirements  definition  process.  Statements  of  weapon  system 
requirements  result  from  continuing  evaluations  of  existing 
technology,  threat,  doctrine,  organizations,  and  material 
systems  (i.e.,  technical  and  operational  suitability,  system 


*DoDD  5000.1,  "Major  System  Acquisitions,"  March  19,  1980. 

DoDI  5000.2,  "Major  System  Acquisition  Procedures,"  March  19,  1980. 
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assessments,  logistic  assessments,  and  readiness  reviews). 

These  evaluations  are  known  as  mission  area  analyses  (MAA). 

MAA  needs  also  arise  from  Program  6.1  "technology  base"  efforts. 
MAA  deficiencies  or  needs  are  translated  into  mission  element 
need  statements  (MENS)  and  forwarded  to  the  Secretary  of  Defense 
for  approval. 

MILESTONE  0  ( ZERO )-- CONCEPT  EXPLORATION  PHASE 

Approval  of  the  Mission  Element  Need  Statement  by  5ECDEF 
constitutes  the  first  decision  point  of  the  acquisition  process. 
(This  decision  milestone  was  added  in  1977).  A  Secretary  of 
Defense  Decision  Memorandum  is  issued  to  the  Service(s)  to 
explore  and  develop  alternative  system  concepts  to  satisfy 
the  approved  need.  A  major  part  of  this  phase  is  the  develop¬ 
ment  of  program  estimates  for  each  of  the  conceptual  system 
alternatives.  These  estimates  are  not  considered  firm  since 
systems  are  not  clearly  defined  and  the  values  for  system  param¬ 
eters  are  uncertain. 

MILESTONE  1 --DEMONSTRATION  AND  VALIDATION  PHASE 

The  second  decision  point  is  reached  at  the  end  of  the 
Concept  Exploration  Phase.  The  program  life-cycle  cost  esti¬ 
mates  (LCCE)  tnat  address  the  estimated  acquisition  (develop¬ 
ment  and  procurement)  and  ownership  (operating  and  support) 
costs  of  all  the  alternatives  to  be  considered  at  this  decision 
point  are  incorporated  into  a  document  called  the  Decision 
Coordinating  Paper  (DCP).  The  DCP  provides  the  primary  docu¬ 
mentation  (acquisition  strategy,  alternatives,  and  issues)  for 
use  by  the  DSARC  in  arriving  at  its  milestone  recommendation. 

One  or  more  systems  are  nominated  by  the  DSARC  to  proceed 
through  the  next  phase  of  the  acquisition  process.  For  very 
select  high-interest  programs,  the  acquisition  portion  of  the 
LCCE  is  incorporated  into  a  program  monitcrship  report.  This 
report,  established  in  1968  ,  is  called  the  Selected  Acquisition 
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Report  (3AR) . 1  It  serves  as  the  baseline  lor  monitoring  future 
program  performance.  At  this  point,  the  3AR  program  estimate 
is  referred,  to  as  the  "planning  estimate."  The  planning  esti¬ 
mate  is  also  used  in  the  Planning-Programming-Budgeting  System 
(PPBS)  to  plan  for  the  financing  of  the  program. 

During  this  phase,  prototype  systems  may  be  developed  and 
tested  to  prove  that  hardware  can  be  built  to  meet  the  require¬ 
ment  of  the  conceptual  system.  The  program  selected  at  Mile¬ 
stone  I  may  not  call  for  total  development  of  a  new  system. 

The  selected  program  may  only  involve  modifying  an  existing 
system  to  a  configuration  that  meets  the  required  need.  In 
such  cases,  prototype  systems  are  not  built.  At  the  end  of 
this  phase,  an  analysis  is  conducted  to  prepare  for  the  next 
decision  point.  This  analysis  involves  reconfirmation  or  rejus 
tification  of  the  requirement  against  the  latest  threat  assess¬ 
ment,  and  the  preparation  of  updated  program  estimates.  These 
estimates  make  use  of  new  information  acquired  during  the  devel 
opmental  and  testing  efforts.  These  are  the  first  estimates 
based  on  information  gained  from  actual  development  and  testing 
of  system  hardware. 

MILESTONE  I I-- FULL- SCALE  DEVELOPMENT  PHASE 

The  third  decision  point  of  the  acquisition  process  occurs 
at  the  end  of  the  demonstration  and  validation  phase.  The  pro¬ 
gram  estimates  of  all  the  alternatives  are  again  recorded  in 
the  DCP.  The  estimate  of  the  program  alternative  selected  by 
the  (S)SARC  and  DSARC  becomes  the  new  baseline  for  the  program. 
Management  thresholds  are  established  about  this  new  program 
estimate.  These  thresholds  serve  as  a  means  for  controlling 
the  program  within  prescribed  levels  of  allowable  changes  that 
may  subsequently  occur.  Concurrently ,  the  acquisition  portion 

lDoDI  7000. 3j  "Selected  Acquisition  Report,"  April  4,  1979. 
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of  the  program  estimate  is  substituted  ir.  one  ZAP.  for  ohe 
planning  estimate,  and  becomes  ohe  new  baseline  for  monitoring 
program  performance.  In  the  SAR  this  revised  baseline  is 
referred  to  as  the  "development  estimate."  This  estimate  is 
also  used  for  programming  and  budgeting  purposes.  It  must  be 
noted  that  for  most  systems,  SAR  submissions  begin  after  a 
Milestone  II  decision  has  been  made. 

Prototype  systems  are  also  built  during  this  chase  of  the 
program.  In  the  demonstration  and  validation  phase,  prototypes 
were  built  to  demonstrate  the  ability  to  build  a  weapon  system 
possessing  the  capabilities  required  to  respond  to  the  need. 
Having  proven  this  capability,  the  prototypes  in  full-scale 
development  are  built  to  demonstrate  the  ability  of  the  system 
to  perform  successfully  in  the  field  and  to  demonstrate  the 
adequacy  of  the  system's  design  for  eventual  quantity  produc¬ 
tion.  Upon  completion  of  this  phase,  another  analysis  is  con¬ 
ducted  in  preparation  for  the  final  program  decision.  This 
analysis  again  involves  reconfirmation  or  rejustification  of 
the  requirement  against  the  latest  threat  assessment  and  the 
preparation  of  updated  program  estimates. 

MILESTONE  1 1 1--PR0DUCT  ION  AND  DEPLOYMENT  PHASE 

The  procedures  associated  with  the  fourth  and  final  deci¬ 
sion  of  the  acquisition  process  are  quite  similar  to  the  Mile¬ 
stone  II  procedures.  The  program  estimate  of  the  alternative 
selected  becomes  the  new  baseline  in  the  DCP.  Thresholds  are 
also  revised  and  a  new  SDDM  issued.  The  cost  estimate  becomes 
the  current  estimate  in  the  SAR.  The  development  estimate 
established  at  the  time  the  program  entered  full-scale  develop¬ 
ment  continues  as  the  SAR  baseline. 

With  the  Milestone  III  decision  made,  the  program  proceeds 
Into  production.  Unless  problems  occur  during  this  phase  that 
cause  a  DCP  threshold  to  be  exceeded,  the  program  never  returns 
to  the  (S)SARC  or  DSARC  for  another  decision.  However,  progress 
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of  the  program  continues  to  be  monitored  by  review  of  the  SAR 
until  ninety  percent  of  the  production  program  is  completed. 

At  that  time,  the  SAR  is  terminated. 

B.  VARIATIONS  IN  THE  PROCESS 

The  acquisition  managers  may  determine  that  a  specific 
system  program  need  not  pass  sequentially  through  all  the  phases 
of  the  process.  Programs  may  also  require  major  restructuring 
before  a  particular  phase  of  the  acquisition  process  is  com¬ 
pleted.  Variations  from  the  normal  acquisition  process  are 
determined  on  a  case-by-case  basis. 

C.  THE  A-X  AS  AN  EXAMPLE  OF  DEFENSE  SYSTEM  ACQUISITION 

No  major  weapon  system  has  passed  through  all  milestones 
of  Defense  acquisition  review  since  Milestone  0  was  added  to 
the  previous  milestones.  Thus,  no  program  can  be  cited  as  a 
perfect  example  of  compliance  with  the  current  process.  The 
A-X  (now  A-10 )  Program  does,  however,  exemplify  the  process 
with  the  exception  of  Milestone  0,  and  the  events  leading  to 
its  initiation  are  described  herein  for  comparison  with  current 
Milestone  0  requirements. 

CONCEPT  EXPLORATION  (NOW  MILESTONE  0) 

In  December  1966,  the  Tactical  Air  Command  forwarded  a 
"Stated  Operational  Requirement"  (SOR)  for  an  aircraft  to  be 
designed  for  highly-survivable ,  heavily-armed,  Close  Air  Sup¬ 
port  (CAS)  of  front-line  troops.1  This  would  lead  to  the  first 
aircraft  so  specifically  designed  for  the  U.S.  Air  Force.  (Today 
the  Air  Force  would  be  required  to  submit  a  Mission  Element  Need 
Statement  (MENS)  to  document  the  need  for  the  mission.  Approval 


'Defense  Marketing  Service,  Military  Aircraft ,  1979- 
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In  the  case  of  the  A-X,  the  Request  for  Proposal  (?.??)  for 
design  studies  of  CAS  aircraft  was  circulated  in  March  1367. 
Following  completion  of  the  design  studies,  the  RFP  for  proto¬ 
typing  went  to  twelve  aircraft  companies  (in  May  1370).  Boeing 
Cessna,  Fairchild,  General  Dynamics,  Lockheed  and  Northrop 
responded.  In  December,  the  Air  Force  tentatively  selected 
Northrop  to  prototype  two  YA-9As,  and  Fairchild  two  YA-lOAs. 


MILESTONE  I - - DEMQNSTRAT I  ON  AND  VALIDATION 

The  Defense  Systems  Acquisition  Review  Council  (DSARC)  met 
on  December  17,  1970  and  approved  the  A-X  Program  for  proto¬ 
typing.  (Note:  the  initial  SAR  was  submitted  as  of  30  Juner137 
A  competitive  fly-off  of  the  Northrop  and  Fairchild  demonstra¬ 
tion  vehicles  was  completed  in  December  1972. 

MILESTONE  1 1 - - FULL- S CALE  DEVELOPMENT  (FSD) 

On  January  17,  1973,  the  DSARC  met  to  consider  the  Air 
Force  selection  of  the  Fairchild  YA-10A  as  the  winner  and  to 
approve  the  program  for  FSD.  A  Design-to-Cost  (DTC)  goal  of 
$1,532,000  average  unit  flyaway  cost  (FY  1970  Constant  Dollars) 
for  600  aircraft  at  a  peak  rate  of  20  per  month  was  also  estab¬ 
lished.  Formal  SECDEF  approval  of  the  A-10  for  FSD,  including 
six  pre-production  aircraft,  occurred  January  18,  1973-  The 
Development  Estimate  at  the  DSARC  II  became  the  baseline  for 
the  program. 

MILESTONE  1 1 1 -- PRODUCT  I  ON  AND  DEPLOYMENT 

The  Air  Force  returned  to  the  DSARC  on  July  9,  1974  for 
approval  of  the  A-10  for  initial  production.  Long-lead  pro¬ 
curement  items  were  authorized  on  July  31,  and  after  another 


*0000  5000.1,  Sec.  D,  paragraph  3a,  p.  4. 
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DSARC  meeting  on  November  19,  197^,  SECDEP  approved  the  first 
22  production  A-lOAs  on  December  19,  197^-  The  Air  Force  gave 
Fairchild  a  contract  for  this  quantity  on  December  20.  (Nor¬ 
mally,  a  DSARC  IIIB  is  held  to  go  to  rate  production.  In  the 
case  of  the  A-10  Program,  a  Development  Concept  Paper  (DCP  23) 1 
was  signed  in  lieu  of  DSARC  IIIB  on  February  10,  1976). 

D.  USE  OF  SELECTED  ACQUISITION  REPORT  (SAR)  DATA 

The  SAR  is  an  official  DoD  quarterly  report  that  is  closely 
linked  to  the  major  weapon  system  acquisition  and  DSARC  milestone 
processes.  As  such,  the  SAR  provides  a  definitive  and  standard¬ 
ised  source  of  data  that  has  proved  to  be  invaluable  in  develop¬ 
ing  our  proposed  methodology  for  predicting  probable  schedule 
and  cost  growth  during  a  major  weapon  system's  acquisition 
cycle.  The  Program  Manager  prepares  and  the  Services  submit 
reports  as  of  31  March,  30  June,  30  September,  and  31  December. 
The  reports  are  forwarded  through  appropriate  channels  to  the 
Assistant  Secretary  of  Defense  (Comptroller)  for  submission  to 
the  Congress.  The  31  December  report  is  important  because  it 
coincides  with  the  Presidential  budget  submission  to  the  Con¬ 
gress.  Thus,  the  Services  and  OSD  must  take  care  to  ensure 
that  the  SAR  data  contained  in  the  Current  Estimate  ( CE )  match 
budget  items  and  the  January  Five-Year  Defense  Program  (FYDP). 

The  CE  is  the  Service's  latest  forecast  of  the  operational/ 
technical  characteristics,  schedule,  and  program  acquisition 
cost  to  acquire  stated  quantities.  Since  the  March,  June, 
and  September  SAR  submissions  go  to  Congress  while  that  body 
Is  debating  authorizations  and  appropriations  for  those  weapon 
systems,  program  changes  to  these  reports  are  usually  limited 
to  those  resulting  from  a  Congressional  action  or  DSARC  deci¬ 
sion.  Otherwise,  SARs  support  documentation  and  testimony 

1The  "Development  Concept  Paper"  is  now  called  the  Decision  Coordinating 
Paper. 


already  before  the  Congress.  Inasmuch  as  the  final  budget  is 
usually  not  voted  in  time  to  be  incorporated  in  the  30  Septem¬ 
ber  SARs,  thorough  SAR  updates  normally  occur  annually  only 
in  December. 

Meanwhile,  the  internal  DoD  processes — e.g.,  the  POM,  PDM, 
October  Budget  Estimates  Submission — may  have  substantially 
changed  a  particular  SAR  program,  and/or  the  costs  associated 
therewith.  For  the  reasons  cited  above,  the  December  SAR  is 
likely  to  be  the  only  quarterly  submission  that  is  a  timely 
"snap-shot"  of  a  program's  status.  Hence,  our  study  effort 
focused  on  the  data  contained  in  the  31  December  reports. 

Figure  1  is  an  example  of  a  SAR  Milestone  Schedule  and  Figure 
2  is  an  example  of  a  SAR  Annex,  detailing  a  program's  acquisi¬ 
tion  cost.  A  perusal  of  Figure  2  will  quickly  pinpoint  one 
limitation  of  the  SAR:  the  cost  data  presented  in  the  report 
are  highly  aggregated.  Admittedly,  we  would  prefer  a  data 
source  with  much  more  detail  available.  We  evaluated  the 
potential  of  other  documents  such  as  the  Decision  Coordinating 
Paper  and  the  Integrated  Program  Summary  (IPS).  We  opted  to 
use  the  SAR  because  of  its  visibility  at  decisionmaking  levels 
and  because  it  has  a  prescribed  format  common  to  all  Services, 
which  allows  year-to-year  comparisons  to  be  made. 

With  the  following  exceptions,  schedule  and  cost  data  used 
in  this  study  were  extracted  from  the  31  December  1980  and 
earlier  SARs.  Two  Army  systems,  STINGER  and  M-l  Tank,  attained 
IOC  in  early  Calendar  Year  1981;  hence,  data  from  the  March 
1981  SARs  were  used  for  these  programs  in  order  to  pinpoint 
estimated  costs  at  IOC. 
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DEVELOPMENT  ESTIMATE 
Goals  (not  thresholds) 
approved  at  Milestone  II 


i  co  |  o  ® 

LU  •“  ^ 

-E  O 


> 

(0 

®  2 

> 

« 

a  o) 

c 

o 

k_  w 

</> 

•s  a  ♦- 
c  C  C 

<0 

a 

® 

®  c  — 

CO 

e 

(0  9  O 

O 

s 

«  c  ^ 

— »  _  CO  _  -  ^ 

q  i  =  i  .2  * 


Q  3  a 

LU  w  C 

T  O)  O 

o  2  g 

wo.® 


2  ~  <o  _ 
35  .2  ®  o 

o  4-*  X  A 

2  •=  a  O 
a  .5  O  “ 


o  \ 

1  ® 

i= 

S 

—  « 
o  -o 

•  c 

2  3 
VJ  ■=  ■a 
ui  5  « 

ac  M  a 
uj  ©  « 
>  ^  o 

—  3  o 

-J  —  <0 

Q  i  .a 


« 

o 

c 

®  w 

§*  ® 

S  c  « 
o  ®  Js 

*  a  § 

*82 
3  ®  3 

«  2  - 

*  o  3 

2.SS 

e  O  ♦* 

2  J  « 
a  <  c 


Ji 


FIGURE  1.  Selected  Acquisition  Report 

Format  D--Schedule  Milestones 


PLANNING/DEVELOPMENT 

ESTIMATE 


:IGURE  2.  Selected  Acquisition  Report 

Format  E--Program  Acquisition  Cost 


IV.  SELECTED  ACQUISITION  REPORT  (SAR)  DATA 


A.  INTRODUCTION 

During  the  research  phase  of  this  study,  schedule  and  cost 
data  on  weapon  systems  were  extracted  from  the  SARs,  separated 
into  four  weapon  system  categories  (missiles,  aircraft,  ships, 
other)  and  subsequently  analyzed.  Cur  initial  analysis  of  the 
data  revealed  that  the  SAR  reporting  process,  while  evolving 
over  time,  took  on  an  added  dimension  in  calendar  year  1375. 

Prior  to  that,  cost  estimates  were  only  expressed  in  current 
or  "then  year"  dollars,  with  no  common  basis  for  year-to-year 
comparison.  Commencing  with  the  December  31,  1975  SAR  and  all 
subsequent  submissions,  program  cost  estimates  are  presented 
in  both  current  and  constant-year  dollars,  thus  providing  the 
requisite  measure  of  comparability  as  well  as  a  means  to  quickly 
assess  the  effects  of  inflation  on  a  particular  program.  Con¬ 
stant  dollar  values  will  be  used  throughout  this  report.  In 
those  circumstances  where  data  were  extracted  from  pre-1975 
SARs,  the  current  dollar  figures  were  escalated/de-escalated , 
as  appropriate,  to  a  given  base-year  constant  dollar  figure 
(i.e.,  ;he  constant-year  dollar  base  cited  in  1975  and  later 
SARs). 

8.  ISOLATING  THE  IMPACT  OF  INFLATION 

Individual  SARs  reflect  the  estimated  program  costs  in 
both  constant  and  current  dollars,  the  latter  value  being  derived 
by  adding  actual  and  anticipated  inflation  costs  to  the  constant 
dollar  value  of  the  estimate.  Nowadays,  it  is  not  uncommon  to 
discover  that  the  original  (base-year  constant  dollar)  estimate 
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of  a  program's  cost  has  more  than  doubled  when  examined  in 
terms  of  today's  value  of  the  dollar  (i.e.,  current  dollar 
value).  Although  in  this  report  we  express  cost  values  only 
in  terms  of  constant  dollars,  we  do,  nevertheless,  recognize 
and  acknowledge  that  public  pronouncements  on  cost  growth  in 
weapon  system  acquisition  programs  are  usually  made  without 
adjusting  for  inflation  (i.e.,  in  current  dollars).  Given  the 
normal  development  cycle  for  a  new  weapon  system  (ten  or  more 
years  seems  representative),  the  impact  of  inflation  in  a  pro¬ 
gram  can  be  severe.  We  would  observe  that  since  the  DoD  in  and 
of  itself  cannot  control  inflation  or  its  effects,  it  is  more 
useful  to  focus  on  constant  dollar  growth  as  a  more  meaningful 
measure  of  management  effectiveness  in  a  particular  program. 

To  maintain  uniformity  in  the  DoD  budget  process,  the  OSD 
Comptroller  periodically  updates  escalation  indices  associated 
with  a  particular  appropriation  (RDT&E,  MILCON,  etc.).  The 
indices  are  published  several  times  during  the  fiscal  year 
based  on  guidance  received  from  the  Office  of  Management  and 
Budget  (OMB)  so  that  the  stated  budget  requirements  for  a  com¬ 
modity  or  system  will  accurately  reflect  the  current  buying 
power  of  the  dollar.  A  program  manager  normally  maintains  an 
audit  trail  of  his  program  on  a  constant  dollar  basis;  thus, 
in  preparing  a  quarterly  3AR  submission  he  would  use  the  indices 
to  "inflate"  his  program's  Current  Estimate  constant  dollar 
costs  to  the  corresponding  current  dollar  value.  The  process 
whereby  inflation  indices  are  updated  is  the  end  product  of  a 
comprehensive  effort  to  collect  data  from  a  myriad  of  sources 
within  both  the  public  (including  each  military  service)  and 
private  sectors  of  the  economy.  One  word  of  caution:  The 
historical  inflation  experienced  by  one  Service  in  a  particular 
appropriation  (e.g.,  aircraft  procurement)  may  differ  from  that 
experienced  by  another  Service. 


C.  DATA  COLLECTION  CHARTS 


As  an  aid  to  more  rigorous  analysis,  a  simple  graphing 
technique  was  employed  to  portray  the  schedule  and  cost  growth 
luring  both  the  development  and  the  procurement  phases  of  a 
particular  acquisition  program.  The  development  chart  displayed 
the  changes  in  the  estimate  of  when  the  system  would  attain  its 
Initial  Operational  Capability  (IOC)  and  the  growth,  ever  time, 
in  estimated  development  costs  (RDT&E)  .  See  Fig.  3  for  3-  sample 
development  chart.  The  procurement  chart  captured  the  changes 
in  the  Procurement  Unit  Cost  (PUC)  and  procurement  quantities  of 
the  system  as  measured  from  the  date  of  the  Development  Estimate 
(i.e.,  completion  of  MILESTONE  II)  through  the  IOC  date  and  up 
to  the  present  (or  whenever  the  3AR  reporting  requirement  for 
a  particular  system  ceased).  The  Procurement  Unit  Cost  is 
derived  by  dividing  the  total  procurement  costs  (i.e.,  flyaway, 
other  weapon  system,  and  initial  spares)  by  the  quantity  of 
systems  to  be  procured.  See  Fig.  4  for  a  sample  procurement 
chart.  Although  a  majority  of  earlier  studies  of  cost  growth 
opted  to  analyze  growth  on  a  "Program  Acquisition  Cost"  basis, 
this  study  has  elected  to  examine  the  program  in  more  detail  by 
segregating  the  development  cost  from  the  procurement  cost  growth 
patterns.  It  should  be  understood,  however,  that  the  Program 
Acquisition  Cost  is  simply  the  sum  of  the  development,  procure¬ 
ment  and  military  construction  costs. 

During  the  course  of  our  investigations,  a  total  of  67  SAR 
systems  were  examined;  of  that  total,  37  systems  which  had 
achieved  IOC  were  selected  for  detailed  analysis.  Each  system 
was  assigned  to  one  of  four  material  categories:  missiles, 
aircraft,  ships,  and  other.  We  anticipate  that  in  future 
updates  of  this  paper,  when  additional  systems  currently  under 
development  reach  IOC,  the  category  "other"  will  be  replaced 
by  two  new  categories:  command,  control,  communications  and 
intelligence  (C°I)  and  tracked  vehicles  and  other  weapons. 
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For  purposes  of  exposition,  primary  focus  was  placed  on  the 
missile  systems.  The  charts  that  had  been  developed  earlier 
(Figs.  3  and  4)  were  then  re-checked  to  see  if  any  apparent 
anomalies  existed  in  the  data  that  might  prejudice  use  of  the 
data  as  a  predictor  of  future  growth.  For  example,  in  the  area 
of  procurement  unit  costs  one  would  intuitively  expect  that  the 
PUC  would  increase  significantly  if  the  procurement  quantities 
were  cut.  Likewise,  one  would  anticipate  that  a  significant 
.increase  in  quantity  would  reduce  the  PUC,  or  at  least  hold 
the  cost  constant  from  one  year  to  the  next.  In  the  case  of 
the  U.S.  Air  Force  Short-Range  Attack  Missile  (SRAM),  the  latter 
expectation  did  not  hold — at  one  point  prior  to  IOC  the  procure¬ 
ment  quantities  increased  by  a  factor  of  2.7  and  the  procurement 
unit  costs  increased  by  a  factor  of  4.3.  Unfortunately ,  the 
SRAM  was  an  early  program  that  reached  IOC  in  August  1972. 

The  data  and  analyses  presented  in  the  SRAM  SAR  were  quite 
sketchy.  A  massive  cost  increase  (by  a  factor  of  7.6  times  the 
Developmen  Estimate  of  procurement  costs)  was  attributed  to 
an  "Estimating  Change."  Unable  to  isolate  the  actual  factors 
involved  in  the  SRAM  developmental  history,  we  elected  to 
exclude  SRAM  data  from  any  further  consideration.  It  must  be 
reiterated,  however,  that  the  basic  aim  of  this  paper  is  to 
develop  schedule  and  cost  growth  factors,  and  not  to  delve  into 
the  reasons  for  growth.  We  must  also  point  out  that  the  esti¬ 
mated  cost  data  contained  in  SAR  reports  is  not  normalized 
(i.e.,  adjusted  for  quantity  changes).  Given  this  fact  and 
recognizing  the  virtual  impossibility  of  accurately  predicting 
probable  future  quantity  changes  in  a  given  weapon  system  pro¬ 
curement  program,  we  elected  to  pursue  the  development  of  our 
methodology  without  relying  on  normalized  cost/quantity  data. 
This  decision  was  reinforced  by  our  initial  findings,  which 
are  discussed  in  the  following  section. 


27 


D.  INITIAL  FINDINGS 


After  the  development  and  procurement  charts  were  completed, 
they  were  reviewed  to  determine  if  any  trends  could  be  discerned. 
This  initial  inspection  of  the  charts  led  to  two  findings : 

1.  Achievement  of  IOC  marks  the  end  of  significant  growth 
in  both  development  and  procurement  costs  for  most  sys¬ 
tems.  (Note:  the  IOC  date  is  usually  the  last  schedule 
milestone  subject  to  a  DCP  threshold  restriction) . 

2.  Procurement  quantities  are  as  likely  to  increase  as 
they  are  to  decrease.  For  5o  programs  at  or  cevond 
IOC,  procurement  quantities  increased  from  the  devel¬ 
opment  estimate  in  19  cases,  decreased  in  1 6  cases, 
and  remained  unchanged  in  three  cases  (see  Table  I'. 

This  finding  is  at  variance  with  the  commonly  held 
belief  that  as  the  acquisition  cycle  evolves,  smaller 
quantities  of  systems  are  procured  than  planned 
earlier  because  of  the  effects  of  schedule/cost  growth 
and  constrained  budgets.  However,  It  should  be  noted 
that  the  Army  tended  to  procure  fewer  quantities  than 
planned,  while  the  Air  Force  and  Navy  tended  to  pro¬ 
cure  more.  The  same  procurement  quantity  growth 
factors,  grouped  by  type  of  system,  are  as  follows: 


Ai rcraf t 
Missiles 
Ships 
Other 

Total 

The  procurement  quantity  growth  factors  by  type  of 
system  do  not  show  any  strong  biases  toward  factors 
greater  than  one  or  less  than  one. 
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PROCUREMENT 

QUANTITY 

GROWTH  FACTORS 

<1  .0 

1  .0 

>1  .0 

3 

2 

4 

8 

0 

10 

3 

1 

3 

2 

0 

2 

1  6 

3 

19 

2  8 


Table  1.  PROCUREMENT  QUANTITY  GROWTH  FACTORS- - SY STEMS  AT 
OR  BEYOND  IOC  (AS  OF  FEBRUARY  1981) 


Service 

— 

System 

Procurement  Quantity  Growth  Factors 

Planning 

Estimate 

Deve 1 opmen t 

E  s  t i ma  te 

IOC 

Latest 

SAR 

Army 

DRAGON 

- 

1  .00 

0 . 35 

0.27 

I -HAWK 

1.01 

1  .00 

0.61 

0.86 

LANCE 

- 

1  .00 

1  .  00 

2.00 

M- 1  TANK 

- 

1  .00 

2.13 

2.13 

M-198 

- 

1  .00 

0.96 

0.59 

STINGER 

- 

1  .00 

1  .  33 

1.33 

TACFIRE 

- 

1  .00 

1  .02 

0  .  "2 

TOW 

. 

1  .00 

0.48 

0 . 59 

UH-60 

- 

1  .00 

1  .  30 

1  .00 

Air  Force 

A- 1 0 

1  .00 

1  .00 

1.01 

0.94 

j  E-3A 

1  .00 

0  .  74 

0.74 

,  E'4 

- 

1  .00 

0 .33 

0.33 

F- 1  5 

** 

1  .00 

1  .00 

1  .00 

F  -  1  6 

- 

1  .  00 

2.14 

2.14 

MAVERICK  A/8 

- 

1.00 

1.29 

1.18 

MINUTEMAN  III 

- 

1  .00 

0.95 

1.13 

SIDEWINDER  ( 9 L )  1 

. 

1.00 

1  .89 

1  .64 

SPARROU  (  7F )  1 

. 

1  .00 

1  .36 

1  .  72 

SRAM 

- 

1  .00 

2.14 

2.14 

Navy2 

CAPTOR 

1.00 

0.15 

0.69 

C  VAN-68 

- 

1  .00 

1  .00 

1  .00 

DO-963 

1  .00 

1  .03 

1  .03 

DLGN-38 

1  .33 

1  .00 

1  .  33 

1  .33 

E-2C 

_ 

1.00 

1  .  68 

3.61 

FFG-7 

1  .00 

1.10 

0.92 

F-14 

‘ 

1  .00 

0.70 

1  .05 

HARPOON 

1  .46 

1  .00 

0  .  73 

0  .  73 

LHA 

“ 

1  .00 

0 . 56 

0.56 

MK-48 

1 .00 

1  .00 

0.68 

NATO- PHM 

" 

1  .  00 

0.18 

0.18 

PHALANX 

1  .00 

1  .  26 

1  .27 

PHOENIX 

- 

1  .00 

1  .07 

1  .55 

POSE  I QON 

- 

1  .00 

1  .01 

0.95 

P-3C 

- 

1  .00 

1  .85 

3.04 

SIDEWINOER  ( 9L ) 

- 

1  .00 

1.18 

1.14 

SPARROW  ( 7  F) 

- 

1  .  00 

0.63 

0.90 

SSN-688 

1  .00 

1  .  22 

1  .  34 

TRIDENT  MISSILE 

_ I _ 

1  .00 

0.94 

. 

1  .06 

‘System  developed  by  U.S.  Navy.  USAF  has  separate  procurement  program. 

2AEGIS  Program  not  listed  since  procurement  is  included  in  individual  shipbuilding  programs. 
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SCHEDULE  GROWTH 


Schedule  growth  during  development  of  a  new  weapon  system 
is  normally  measured  by  the  amount  of  slippage  experienced  in 
a  program  between  a  fixed  base  date  re.g.,  the  approval  date  of 
either  the  Planning  Estimate  or  the  Development  Estimate/  and 
the  attainment  of  the  system's  Initial  Operational  Capability. 
To  avoid  confusion,  schedule  growth  discussed  in  this  report 
will  use  the  ICC  date  established  at  the  time  of  Development 
Estimate  approval  as  the  base  date.  All  systems  in  each  of  the 
four  weapon  system  categories  were  analyzed  individually.  Afte 
the  necessary  data  were  collected,  the  cumulative  total  growth 
factor  was  computed  using  the  following  formula: 

Actual  time  (in  years)  from 

Cumulative  total  _  DE  approval  to  ICC _ 

growth  factor  Initial  estimated  time  (in  -years!) 

from  DE  approval  to  IOC 

Table  2  displays  schedule  growth,  by  category,  for  the 
systems  analyzed.  This  table  also  includes  the  average  elapsed 
time  in  years  required  for  the  "typical"  system  in  a  particular 
category  to  attain  IOC.  Mean  and  median  values  for  the  various 
categories  are  also  summarized.  We  recommend  more  weight  be 
given  to  median  values  than  to  mean  values  in  our  cost  growth 
methodology.  As  can  be  seen  in  Table  2  (Aircraft),  a  single 
program  (the  E-4)  can  have  an  undue  effect  on  mean  values. 

As  an  example,  within  the  missile  category,  the  schedule 
growth  ranged  from  zero  growth  for  the  MINUTEMAN  III  and  Mk-48 
Torpedo  programs  to  a  growth  of  7-1/4  years  above  the  initial 
estimate  of  the  time  interval  between  the  date  of  Development 
Estimate  approval  and  the  initially  estimated  date  of  IOC 
attainment  for  the  SPARROW  program.  The  actual  time  required 
to  attain  ICC,  as  measured  from  the  date  of  DE  approval, 
ranged  from  2-1/4  years  to  11  years.  The  mean  and  median 
figures  for  this  time  interval  were  5.7  and  5.0,  respectively. 


Table  2.  SYSTEM  SCHEDULE  GROWTH 


7  ime 

Cumulati ve 
Total  Growth 
Factor 

Cateqory 

System 

Daee  af 
Development 
Estimate 

Initial 

Estimate 

IOC  Date 

Actual 

IOC 

Date 

'ears --Dev. 
Estimate  To 
Est.  IOC 

'ears --Dev .  i 
Estimate  To 
Actual  IOC  . 

Aircraft 

A- 10 

5/71 

6/77 

10/77 

6.1 

6.4 

1.35 

5-20 

4/68 

11/73 

2/74 

6.6 

5.6 

1.34 

E-3A 

5/71 

3/77 

A/ 78 

:  5.3 

5.3 

1.18 

£-4 

1/73 

6/74 

A/75 

1.4 

2.3 

1 .54 

F-14 

1/69 

4/73 

12/73 

4.3 

4.9 

1.14 

F-15 

1/70 

7/75 

9/75 

5.5 

5.7 

1.34 

F- 16 

3/75 

10/80 

10/80 

5.6 

5.5  j 

1  .00 

P-3C 

5/67  i 

3/70 

7/70 

2-3. 

3.1 

1.13 

JH-oO 

6/71  1 

6/79 

11/79 

8.0 

3. A  ; 

1 .05 

MEDIAN 

! 

5.6 

5.7 

1 .05 

MEAN 

i  i 

5.0 

5.4 

1.14 

Missiles 

CAPTOR 

6/71 

1  9/76 

7/79 

5.3 

3.1 

1 .64 

DRAGON 

7/65 

5/70 

!  9/74 

4.8 

9.2 

1.92 

HARPOON 

6/73 

!  11/75 

7/77 

2.4 

A.l 

1.71 

I -HAWK 

12/68 

4/71 

11/72 

2. A 

3.9 

1.53 

lance 

6/67 

6/70 

6/72 

3.0 

5.0 

1.67 

MR-48 

6/71 

2/72 

2/72 

0.7 

0.7 

i  1.00 

;  MAVERICK  (A/8) 

7/68 

12/71 

2/73 

3.4 

4.6 

i  1.35 

j  minuteman  hi 

3/68 

6/70 

1  6/70 

2.3 

!  2.3 

j  1.00 

j  PHOENIX 

12/62 

4/73 

|  12/73 

10.3 

11.0 

1  1.07 

t  POSEIDON 

11/66 

11/70 

3/71 

4.0 

4.3 

1.08 

;  SIDEWINDER  (N) 

1/71 

3/74 

i  5/78 

3.2 

7.3 

2.28 

j  SPARROW  (N)1 

8/68 

1/69 

4/76 

0.6 

7.3 

13.00 

!  SRAM 

12/66 

2/70 

8/72 

3.2 

5.7 

1.78 

i 

STINGER 

5/72 

9/77 

2/81 

5.3 

8.3 

1 .66 

1 

row 

5/66 

3/68 

9/70 

2.3 

4.3 

1.37 

,  TRIDENT  I 

10/73 

10/78 

10/79 

5-° 

6.0 

1.20 

MEDIAN 

3.2 

5.0 

1.63 

MEAN 

3.3 

5.7 

1.52 

|  Ships 

CVAN  68 

12/67 

3/73  1 

3/76 

5.3 

3.3 

1.57 

i  00  963 

6/70 

6/75 

i  6/77 

5.0 

!  7.0 

1  .40 

OLGN  38 

12/71 

12/75  i 

9/77 

4.0 

5.3 

1  .44 

!  FFG  7 

10/72 

5/78 

3/79 

'  *  1 

6.4 

1.14 

;  iha 

12/68 

2/74 

5/77 

5.2 

3.4 

1.62 

NATO  PHM 

9/72 

3/76 

5/78 

3.5 

5.7 

1.63 

5SN  688 

1/71 

9/74 

11/76 

3.7 

5.3 

1.57 

i 

MEOIAN 

j 

j 

5.0 

6.4 

1.57 

MEAN 

4.6 

6.8 

1 .48 

Other 

AEGIS 

i  12/69 

5/75 

12/79 

10.0 

1.35 

M-1  TANK 

1  12/76 

6/80 

V81 

4.1 

1.17 

M-198 

12/71 

5/77 

4/79 

■ 

7.3 

1.35 

TACFIRE 

1  12/57 

7/74  ] 

4/79 

B 

11.3 

1.71 

PHALANX 

1/73 

1/77 

3/79 

wmm 

6.6 

1.65 

MEDIAN  l 

.  ..  ...j  ..  ..  J 

5.4 

7.3 

1.65 

1 _ 

MEAN  | 

i 

■ 

L  7'3..  1 

1.55 

■values  not  used  to  calculate  the  Mean. 
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The  median  cumulative  total  schedule  growth  amounted  to  1.5; 
times  the  initial  estimate  of  the  time  interval  between  approve 
of  the  DE  and  the  anticipated  IOC  date. 

Rounding  out  our  analysis  of  schedule  growth,  we  developed 
composite  graphs  that  plotted  the  changes  in  the  estimated  time 
required  to  achieve  IOC  for  each  individual  system  over  time — 
extending  from  the  date  of  DE  approval  until  the  actual  date  of 
IOC  achievement  (see  Figs.  5  through  3).  On  each  graph  the 
median  slope  for  that  material  category  was  plotted.  We  exam¬ 
ined  the  actual  shape  of  the  schedule  growth  curves  to  deter¬ 
mine  if  there  were  any  specific  types  of  curves  associated 
with  a  particular  weapon  system  category.  We  posited  three 
types  of  growth  curves  and  their  properties: 

•  Concave:  Early  program  slippage,  with  growth 

leveling  off  prior  to  IOC. 

•  Straight  Line:  Relatively  uniform  growth  throughout 

the  program. 

•  Convex:  Little  if  any  growth  early  in  the 

program,  preponderance  of  growth 
later  in  program  up  to  and  including 
IOC  attainment . 

While  this  proved  to  be  an  Interesting  effort,  we  found  that 
the  missile  curves  were  the  only  category  to  demonstrate  a 
dominant  trend  (i.e.,  toward  concavity).  After  much  delibera¬ 
tion — and  considering  the  degree  of  uncertainty  normally  asso¬ 
ciated  with  the  estimation  process — we  decided  that  it  would 
be  feasible  to  develop  a  schedule  growth  projection  methodology 
based  on  the  median  cumulative  total  growth  rate  experienced  in 
each  weapon  system  category.  Thus,  with  the  exception  of 
mature  missile  programs,  we  feel  that  a  straight-line  projec¬ 
tion  will  adequately  approximate  the  growth  a  specific  program 
will  experience.  The  details  of  the  methodology  will  be  dis¬ 
cussed  in  Chapter  V. 


ESTIMATED  YEARS  FROM  DEVELOPMENT  ESTIMATE  APPROVAL 


ACTUAL  YEARS  FROM  DE  APPROVAL  TO  IOC  ( =  FINAL  POINTS  ON  CURVES) 

®  F-15  »E-4  AF-14  *E-2C 

■  E-3A  OA-10  DP-3C  tfUH-60 

AF-16 


M-27 


FIGURE  5.  Schedule  Growth,  Aircraft 


DEVELOPMENT  ESTIMATE  TO  IOC 


O  HARPOON 
□  SIOEW1NOER 
A  SPARROW 
4  MAVERICK 

<11  M-ll 


■  MINUTEMAN  i  *  POSEIDON  (NO  INTERMEDIATE  DATA) 

•  DRA60N  ®  TOW  (NO  INTERMEDIATE  DATA) 

‘  PHOENIX  -  l-HAWK 

♦  SRAM  $  STINGER 


*  MK-48 

O  THOENT  I 
®  CAPTOR 

*  LANCE 


FIGURE  6.  Schedule  Growth,  Missiles 


L 


ACTUAL  YEARS  FROM  OE  APPROVAL  TO  IOC  <  =  FINAL  POINTS  ON  CURVES) 

*  QLGN-38  *  LHA  *  CVAN-68 

o  00-963  •  NATO  PHM  O  SSN-668 

Q  FF8-7 


FIGURE  7.  Schedule  Growth,  Ships 


0  2  4  6  8  10  12 

ACTUAL  YEARS  FROM  OE  APPROVAL  TO  IOC  ( =  FINAL  POINTS  ON  CURVES) 

•  PHALANX  4  M-198  A  AEGIS  ■  TACFME  o  M-1  TANK 


FIGURE  8.  Schedule  Growth,  Other 
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F.  COST  GROWTH 

The  techniques  applied  in  our  analysis  of  weapon  system 
cost  growth  are  similar  to  those  used  in  our  investigation 
of  schedule  growth.  Cumulative  total  and  cumulative  average 
development  cost  and  procurement  unit  cost  growth  factors 
were  computed  for  each  of  the  four  weapon  system  categories 
using  the  following  formulas: 


Cumulative  total 


_  Estimated  (x  or  y)  at  IOC  date 
Estimated  (x  or  y)  at  DE  approval 
date 


Cumulative  average  =  ^Cumulative  total  growth  factor 

where  x  =  Development  Coso 

y  =  Procurement  Unit  Cost 
n  =  Time  interval  (in  years)  from  date 
of  Development  Estimate  approval  to 
actual  IOC  date. 


To  test  the  validity  of  our  earlier  finding  that  IOC  marks 
the  end  of  significant  cost  growth  for  a  weapon  system  acquisi¬ 
tion  program,  the  cumulative  total  and  the  cumulative  average 
growth  patterns  for  post-IOC  development  and  procurement  costs 
were  examined.  The  growth  rates  were  computed  using  the 
formulas : 


Cumulative  total 


Estimated  (x  or  y)  in  latest  5AR 
Estimated  (x  or  y)  at  IOC  date 


Cumulative  average  =  ^Cumulative  total  growth  factor 

where  x  =  Development  Cost 

y  =  Procurement  Unit  Cost 
t  =  Time  interval  (in  years)  from 
IOC  date  to  latest  SAR  estimate. 
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Table  3  (Development  Cost)  and  Table  4  (Procurement  'Jnit  Cost) 
display  the  post-IOC  cumulative  total  and  cumulative  average 
cost  growth  factors.  These  tables  confirm  that  cost  growth 
after  IOC  is  much  lower  than  prior  to  IOC.  In  our  cost  growth 
methodology  we  ignore  post-IOC  cost  growth. 

Figures  9  through  16  are  plots  of  the  estimated  develop¬ 
ment  and  procurement  unit  costs  for  each  of  the  four  material 
categories.  Mote  that  these  figure^  are  plotted  on  semi- 
logarithmic  scales.  Therefore,  within  each  figure  the  same 
slope  anywhere  on  the  figure  implies  the  same  cumulative  average 
cost  growth  factor.  3ecause  we  are  ignoring  post-ICC  cost 
growth,  each  curve  ends  with  the  SAR  cost  following  achieve¬ 
ment  of  IOC.  As  discussed  on  page  32,  we  again  examined  the 
shape  of  these  curves.  In  the  case  of  development  costs,  the 
missile  and  "other"  categories  exhibited  a  tendency  toward  con¬ 
cavity  (i.e.,  a  slowing  of  growth  rate  toward  the  end  of  the 
program).  In  the  case  of  procurement  unit  costs,  the  ship 
category  also  exhibited  this  tendency.  In  ail  other  cases, 
the  curves  approximated  straight  lines.  On  each  graph,  the 
median  slope  for  that  material  category  was  plotted  using  the 
median  cumulative  average  growth  factor  from  Tables  3  or  4 , 
as  appropriate. 
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Table  3.  DEVELOPMENT  COST  GROWTH  FOR  SYSTEMS  ANALYZED 


Estimated  Development  uosts 
..Minions  of  3ase  ^ear  Constant  S) 
At  Development 

rsrimite  -atest 

Approval  Date  At  IOC  SAR 


jrowtn  -actors 


Jeveiopment  istimate 
Approval  Pate  to  IOC  3a  te  ! 


1970 

281.9 

1968 

129.3 

1970 

761 .0 

1974 

158.3 

1969 

399.5 

1970 

1659.9 

-umuiati  ve 
_ Lotal 


Cumulative 

Average 


ate  to 
^atest  CAR 


Cumulative  j 
"oral _ j 


CAPTOR 

DRAGON 

HARPOON 

I-rtAWK 

LANCE 

MR-48 

MAVERICK  (A/B) 
MINUTEMAN  III 
PHOENIX 
POSEIDON 
SIOEUINOER  (N) I 
SPARROW  (N) 
SRAN4 

stinger 

row 

TRIOENT  I 
MEDIAN 


1971 

85.5 

100.3 

107.2 

1.173 

1.020 

1.069 

! 

I, 

1966 

61.7 

116.9 

116. 3 

1.895 

1.072 

0.995 

V 

1 

1970 

272.0 

301.7 

356.1 

1.109 

1.026 

1.180 

1969 

35.3 

106.6 

145.  S 

1.116 

1.029 

1.055 

1970 

349.0 

356.1 

349.0 

1.320 

1.004 

0.980 

1  ' 

1972 

150.4 

-  155.3 

275.3 

1.036 

1.052 

1.771 

1968 

MS. 7 

124.9 

120.7 

1.079 

1.017 

0.966 

. 

1967 

1835.4 

1846.4 

1800.0 

1.006 

1.003 

0.975 

1963 

94.0 

144.3 

203.1 

1.535 

1.040 

1.407 

Current  J 

1222.1 

1303.3 

1300.2 

1.057 

1.015 

0.997 

1971 

6.6 

44.3 

44.6 

6.788 

1.300 

0.996 

1968 

24.9 

80.2 

91  .4 

3.221 

1.162 

1.140 

Current  i 

157.6 

464.5 

453.8 

2.771 

1.196 

0.979 

1972 

76.4 

120.3 

120.3 

1.575 

1.053 

1.000 

1966 

97.9 

101.9 

117.7 

1.041 

1.009 

1.155 

1974 

2794.1 

2935.4 

2919.1 

1.051 

1.008 

0.994 

1.113 

1.027 

1.000 

1.780 

1.063 

1.133 

! 

AEGIS 

1970 

394.2 

5Q4.J 

*4*1  TANK 

1972 

422.6 

597.3 

N*  198 

1972 

30.9 

41.7 

41.7 

PHALANX 

1972 

38.3 

113.4 

113.6 

T»cn« 

1968 

50.3 

■ 

77.0 

77.0 

MEDIAN 

MEAN 


1.413 

1.042 

1.000 

1.696 

1.073 

1.000 

ESTIMATED  DEVELOPMENT  COST  (MILLION  $) 


ESTIMATED  DEVELOPMENT  COST  (MILLION  $) 


ESTIMATED  DEVELOPMENT  COST  (MILLION  $) 


ESTIMATED  DEVELOPMENT  COST  (MILLION  $) 


r 

t 

i 

i 

i 

( 


YEARS  PROM  DEVELOPMENT  ESTIMATE 
O  M-1  TANK  A  AESIS  •  PHAUNX  ■  TACPME  f  M-19S 

9>ie4t-20 

FIGURE  12.  Development  Cost  Growth,  Other 
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ESTIMATED  PROCUREMENT  COST  (MILLION  S) 


■  E-3A  A  F-14  ®  MJ  •  E-4  *  UH-60 

★  E-2C  □  P-3C  A  F-1«  0  A- 1 0 


FIGURE  13.  Procurement  Unit  Cost  Growth,  Aircraft 


ESTIMATED  PROCUREMENT  UNIT  COST  (MILLION  S) 


0  TRIDENT  0  TOW  A  PHOENIX  *  i-hawk  q  SIDEWINDER  •  DRAGON  0  MAVERICK 

■  MMUTEMAN  ■  *  MK  4S  O  HARPOON  ■  CAPTOR  A  SPARROW  <9  STINGER 


t-ia-ai-aa 


FIGURE  14.  Procurement  Unit  Cost  Growth,  Missiles 


ESTIMATED  PROCUREMENT  UNIT  COST  (MILLION  $) 


3  CV  AM-69  *  CV AM-66  ★  OLGM-38  it  LHA  Q  FFfi-7  O  00-983  ®  NATO  PMM 

FIGURE  15.  Procurement  Unit  Cost  Growth,  Ships 
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ESTIMATED  PROCUREMENT  UNIT  COST  (MILLION  $) 


YEARS  FROM  DEVELOPMENT  ESTIMATE 
■  TACFME  •  PHALANX  C  M-1  TANK  4  N'T** 


FIGURE  16.  Procurement  Unit  Cost  Growth,  Other 


43 


V.  A  METHODOLOGY  FOR  PROJECTING  SCHEDULE  AND  COST  GROWTH 


A.  INTRODUCTION 

An  analyst's  capability  tb  project  probable  growth  in 
weapon  systems  baseline  estimates  is  a  function  of  the  current 
stage  of  system  development  and  information  available  (e.g., 
Baseline  Cost  Estimate,  Independent  Cost  Assessment,  Decision 
Coordinating  Paper,  Integrated  Program  Summary,  SAR,  etc.). 

As  a  system  matures,  information  and  data  become  more  specific 
and  trends  more  visible;  hence  more  refined  growth  projection 
techniques  can  be  used  over  time,  and  hopefully  result  in  more 
accurate  schedule  and  cost  estimates.  Use  of  a  specific  tech¬ 
nique  by  an  analyst  must  be  tempered  by  a  subjective  evaluation 
of  all  available  information.  To  facilitate  understanding  the 
methodology,  let  us  expand  upon  the  information  contained  in 
Chapter  III  of  this  report,  and  assume  that  Fig.  17  represents 
the  typical  acquisition  cycle  time  line  applicable  to  any  weapon 
system  development  program.  For  convenience,  we  have  parti¬ 
tioned  the  time  line  into  specific  time  segments.  The  break¬ 
point  between  segments  was  nominally  established  as  the  date  of 
the  Milestone  decision  meeting.  In  actuality,  the  time  segment 
will  begin  several  months  prior  to  one  Milestone  and  end  several 
months  prior  to  the  next  Milestone.  This  offset  occurs  because 
of  the  time  required  to  develop,  refine,  coordinate,  staff  and 
obtain  Service  and  OSD  approval  of  the  schedule  and  cost  esti¬ 
mates  used  at  the  DSARC  decision  meetings. 
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FIGURE  17.  Acquisition  Cycle  Time  Line 
TIME  SEGMENT  A 

Curing  this  period,  a  Mission  Element  Meed  State¬ 
ment  (MENS)  is  approved  by  OSD.  As  part  of  the 
approval  process,  the  DoB  Component(s)  identifies 
the  general  magnitude  of  acquisition  resources 
they  would  be  willing  to  invest  to  correct  the 
deficiency.  No  engineering  cost  estimate  is 
prepared  at  this  stage  because  a  candidate  system 
has  not  been  defined.  Lacking  adequate  system 
definition,  the  schedule  and  cost  growth  method¬ 
ology  proposed  in  this  paper  is  no*:  applicable 
to  any  program  whose  current  stage  of  development 
lies  within  Time  Segment  A. 


TIME  SEGMENT  B 

This  period  extends  from  the  initial  preparation  of 
the  Planning  Estimate  (PE),  which  is  presented  to 
DSARC  principals  at  decision  Milestone  I,  to  t'-e 
point  in  time  when  the  preparation  of  the  Develop¬ 
ment  Estimate  (DE)  is  initiated-  Unfortunately , 
schedule  and  cost  data  on  systems  which  have  pro¬ 
gressed  through  Time  Segment  B  and  have  attained 
IOC  are  quite  limited.  It  should  be  noted  that  at 


present,  there  are  no  pre-Milestone  II  systems  being 
reported  upon  via  the  SAR.  Usually,  the  PE  is  a 
rough  estimate  based,  in  part,  on  parametric  cost¬ 
ing  techniques.  An  earlier  OSD  study1  provided 
current  dollar  cost  data  on  36  programs  which  were 
in  production  (i.e.,  had  passed  Milestone  III  but 
not  IOC).  Although  its  objective  was  to  document 
the  reasons  for  cost  growth,  the  OSD  study  did,  in 
fact,  report  that  the  estimated  program  acquisition 
costs  (development,  procurement  and  MILCON)  for  the 
36  systems  grew  by  a  factor  of  2.3  during  the  period 
between  Milestone  I  and  Milestone  III.  A  caveat: 
no  suggestion  was  made  or  inferred  in  the  OSD  study 
to  the  effect  that  the  factor  (2.3)  could  or  should 
be  used  to  project  future  costs  of  analogous  develop¬ 
mental  programs.  Using  data  contained  in  post-1975 
SAR  submissions  and  appropriate  OSD  inflation  indices, 
we  converted  the  current  dollar  Planning  Estimate 
costs  for  16  of  the  36  systems  to  a  constant  dollar 
base.  That  data,  together  with  data  on  7  additional 
systems,  are  presented  in  Table  5  simply  to  demon¬ 
strate  that  program  growth  does  occur  between  Mile¬ 
stone  I  and  Milestone  II. 

For  systems  in  Time  Segment  3,  the  IDA  projection 
methodology  assumes  that  only  the  Planning  Estimate 
schedule  and  cost  data  are  available  (i.e.,  no  sub¬ 
sequent  SARs  are  available).  In  those  circumstances 
where  updated  data  are  available,  follow  the  proced¬ 
ures  for  Time  Segment  C.  In  applying  the  Segment  B 
methodology,  one  must  first  calculate  the  probable 
schedule  growth: 

Memorandum  for  Distribution,  "System  Acquisition  Cost  Growth  Study," 
Office  of  the  Director  of  Defense  Program  Analysis  and  Eval ’cation, 
November  12,  1973  - 
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Step  1.  Using  the  program  milestone  schedule 
approved  at  DSARC  I,  determine  the 
estimated  time  (in  years)  from  DSARC  I 
t o  IOC • 

Step  2.  Select  the  appropriate  weapon  system 

category  median  cumulative  total  schedule 
growth  factor  from  Table  2  (e.g.,  air¬ 
craft  =  1.09)- 

Step  3-  Multiply  the  time  span  (in  years)  by  the 
schedule  growth  factor,  then  increase 
the  product  by  20  percent.1 

Step  4.  Convert  the  resultant  time  span  to 

years  and  months;  add  this  figure  to 
the  date  of  the  planning  estimate  to 
obtain  the  probable  date  of  IOC  attain¬ 
ment  . 


Once  the  adjusted  mime  span  between  she  PE  approval 
date  and  the  revised  IOC  date  has  been  determined, 
a  projection  of  the  development  cost  and  procurement 
unit  cost  (at  IOC)  can  quickly  be  calculated  using 
the  following  formula: 


where 


:iocU  or  y)  '  (GF)  <x  X  CpE 


‘"(x  or  y) 


=  Probable  cost  at  projected  IOC  date 
=  Development  cost 
=  Procurement  unit  cost 

=  Median  cumulative  average  growth  factor 
from  Tables  3  or  4,  as  appropriate 

=  Time  span  in  years,  PE  to  projected  IOC  date 

=  Estimated  cost  at  date  of  planning  estimate 
approval  (Milestone  I). 


1This  factor  was  developed  based  on  a  limited  sample  of  seven  systems 
for  -which  -we  were  able  to  obtain  PE,  DE,  and  actual  IOC  data. 
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To  illustrate  how  the  methodology  is  applied,  assume 
that  a  new  aircraft  program  is  being  evaluated  and 
the  following  schedule  and  cost  data  have  been  extracted 
from  the  DCP  and  IPS. 


Schedule 

Milestone  I  -  June  1980 
Milestone  II  -  June  1982 
Milestone  III  -  December  1985 
IOC  -  June  1987 

estimated  Costs 
( PY  81  Constant  $  in  millions) 
Development  -  $2,250 

Procurement  unit  -  $12.5 


Projected  IOC 


1.  Time  span  Milestone  I  to  IOC  -  June  1987-June  1980  = 
7  years. 

2.  Median  cumulative  total  growth  factor,  aircraft  = 
1.05. 

3.  Adjusted  time  span  =  7  x  1.05  x  1.2  =  8.82  =  8  years 
10  months . 

4.  Projected  IOC  =  June  1980  plus  8  years  and  10  months 
April  1989. 


Projected  Development  Cost  at  IOC 

CI0C  =  ( 1 • °57 ) 8 ‘ 8  x  $2,250  =  $3,665  million. 

Projected  Procurement  Unit  Cost  at  IOC 


(1.039)  x  $12.5  *  $17.5  million 


TIME  SEGMENT  C 


This  segment  begins  with  the  initial  Service 
"approval"  of  the  Development  Estimate  prior  .0  the 
DSARC  II  meeting  and  extends  through  the  IOC  date. 

The  key  event  during  this  segment  (with  respect  to 
our  proposed  schedule  and  cost  projection  method¬ 
ology)  is  the  successful  completion  of  development 
testing  and  operational  testing,  referred  to  as 
DT/OT  II,  TECHEVAL/OPEVAL ,  or  DTE  depending  upon 
the  Service  involved.  It  is  almost  axiomatic  that 
the  degree  of  success  achieved  in  a  testing  pro¬ 
gram  will  determine  how  much  additional  schedule 
and  cost  growth  a  program  will  experience  prior 
to  IOC.  As  might  be  expected,  our  historical 
data  indicate  that  there  is  a  high  probability  of 
schedule  slippage  associated  with  completion  of 
DT/OT  II. 

In  Time  Segment  C,  when  only  the  Development  Estimate 
schedule  and  cost  data  are  available  (i.e.,  no  subsequent 
SARs  are  available),  we  recommend  the  following  procedure  for 
predicting  probable  schedule  and  cost  growth.  In  this  circum¬ 
stance,  one  would  first  select  the  appropriate  category  median 
cumulative  total  schedule  growth  factor  from  Table  2  and  then 
multiply  the  estimated  time  interval  from  the  DE  approval  date 
to  the  expected  IOC  date  (in  years)  times  the  schedule  growth 
factor.  Convert  the  resultant  to  years  and  months  and  add  it 
to  the  date  of  DE  approval,  thus  yielding  the  probable  IOC 
date.  In  similar  fashion,  select  the  appropriate  development 
cost  and  procurement  unit  cost  median  cumulative  average 
growth  factors  from  Tables  3  and  4,  then  multiply  the  cost 
values  contained  in  the  DE  by  the  cumulative  average  growth 
factors  compounded  over  the  time  span  In  years  from  the  DE 
approval  to  the  adjusted  IOC  date  to  obtain  the  probable  cost 


values  at  IOC.  This  procedure  should  only  be  used  when  current 
data  are  not  available;  it  should  not  be  used  once  the  first 
updated  December  3AR  is  available.  In  the  latter  circumstance, 
the  procedures  discussed  in  the  following  sections  should  be  used. 

B.  SCHEDULE  GROWTH  PROJECTION  METHODOLOGY 

The  proposed  methodology  for  projecting  schedule  growth  in 
all  weapon  system  acquisition  programs  (with  the  sole  exception 
of  "mature"  missile  programs  which  are  addressed  later)  involves 
a  simple  two-step  process.  The  first  step  requires  the  analyst 
to  graph  the  annual  schedule  growth  to  date  using  the  technique 
discussed  in  Section  E,  Chapter  IV.  The  second  step  generates 
a  straight-line  projection  from  the  Current  Estimate  plot  to  a 
projected  time  span  (in  years)  from  Development  Estimate  date 
to  IOC  date  on  the  IOC  diagonal  on  the  schedule  growth  graph. 

The  projected  time  span  from  the  Development  Estimate  approval 
date  to  the  IOC  date  is  computed  by  using  the  formula: 

hoc  ’  gfcat  x  (ceioc  -  ET)  +  ET 

where 

PTnr  =  Projected  time  span  (in  years)  from  Development 
Estimate  date  to  IOC  date 

GF =  Weapon  System  Category  median  cumulative  total 
schedule  growth  factor  (Table  2) 

CEtqc  =  Current  Estimate  (in  years)  from  Development 
Estimate  approval  to  IOC  date 

ET  =  Elapsed  Time  (In  years)  from  Development  Estimate 
approval  to  current  SAR  date. 

When  analyzing  a  mature  (i.e.,  more  than  three  years  have 
elapsed  since  Development  Estimate  approval)  missile  program 
with  adequate  information  and  data  available,  we  recommend  a 
four-step  process  that  adjusts  for  the  seemingly  concave  nature 
of  missile  schedule  growth  curves; 
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Step  i.  Plot  the  schedule  growth  to  date. 

Step  2.  Review  the  shape  of  analogous  schedule  growth 
curves . 

Step  3-  Subjectively  evaluate  all  available  information. 

Step  4.  Extend  a  curvilinear  projection  from  the  Current 
Estimate  plot  to  a  point  on  the  IOC  diagonal. 

The  following  example  will  demonstrate  how  this  special  applica¬ 
tion  of  the  schedule  growth  methodology  is  used.  We  must  point 
out  that  the  schedule  and  cost  data  of  most  weapon  system  pro¬ 
grams  currently  in  the  Full-ScaTe  Development  phase  of  the 
acquisition  cycle  are  classified.  We  have,  therefore,  opted  to 
use  a  hypothetical  system  in  order  to  permit  more  widespread 
distribution  of  this  paper.  The  example  is  augmented  by  a 
series  of  sketches  (Fig.  13)  to  demonstrate  the  technique. 

EXAMPLE;  Assume  that  we  are  analyzing  a  missile  program 
which  successfully  completed  a  DSARC  II  four  years  ago. 

DT  II  has  commenced,  operational  testing  has  not.  Let  us 
further  assume  that  the  Development  Estimate  originally 
postulated  an  IOC  date  in  4-1/2  years  and  that  in  the  four 
years  since  the  DE  was  approved,  a  total  of  twenty-one 
months  have  been  added  to  the  expected  IOC  date  (i.e., 
after  one  year  of  program  development,  IOC  was  estimated 
to  occur  in  5-1/4  years;  after  twc  years,  5-1/2  years; 
after  three  years,  it  was  still  5-1/2  years,  and  new  after 
four  years,  the  current  estimate  is  that  IOC  will  be 
attained  6-1/4  years  from  the  DE  approval  date  per  infor¬ 
mation  extracted  from  the  latest  5AR) .  Our  first  step 
will  be  to  plot  these  data.  At  Step  2  we  note  that  the 
schedule  growth  graph  appears  to  follow  the  generally 
concave  shape  typical  of  analogous  missile  programs.  Our 
subjective  evaluation  of  the  program  at  Step  3  would  heavily 
weight  the  facts  that  the  program  is  mature  and  operational 
testing  has  not  been  completed.  With  regard  to  the  latter, 
during  the  research  phase  of  this  study  we  examined  the 
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ESTIMATED 


STEP  1 

PLOT  SCHEDULE  GROWTH 


CURRENT  ESTIMATE 


STEP  2 

REVIEW  CATEGORY  SCHEDULE  CURVES 


impact  of  early  and  successful  completion  of  Development 
Test  Il/Operat ional  Test  II  (DT/CT  II)  on  missile  system 
development  programs.  Table  5  provides  an  indication  of 
how  ten  missile  systems  were  affected  by  the  outcome  of 
DT/OT  II.  We  note,  however,  that  sufficient  information 
was  not  available  on  aircraft,  ship  and  ''other"  weapon 
system  categories  to  allow  us  to  report  a  specific  find¬ 
ing.  Finally,  our  decision  at  Step  4  would  be  to  extend  a 
concave  projection  from  the  current  estimate  plot  to  the 
IOC  diagonal.  Our  estimate  would  be  that  the  program  will 
achieve  IOC  7  —  1/4  years  after  DE  aporoval,  on*^  iat— r 

than  the  Current  Estimate. 


Table  6.  SCHEDULE  GROWTH  SUBSEQUENT  TO  DT/OT  II 
(MISSILE  SYSTEMS) 


System 

Date 

DT/OT  II 
Completed 

Estimated 

IOC  Prior 

To  Testing 

Schedule 
Growth 
(in  years) 

CAPTOR 

Jan  75 

Jan  78 

Jul  79 

1.5 

DRAGON 

Nov  72 

Oct  73 

Sep  74 

0-9 

HARPOON 

Mar  77 

Jun  76 

Jul  77 

1.1 

I -HAWK 

Nov  71 

Oct  72 

Nov  72 

0.1 

MAVERICK  (A/B) 

Nov  71 

Feb  73 

Feb  73 

PHOENIX 

Sep  72 1 

Apr  73 

Dec  73 

0.7 

SIDEWINDER 

Jan  76 

May  77 

May  78 

1.0 

SPARROW 

Sep  74 

Sep  74 

Apr  76 

1.6 

STINGER 

Apr  77 

Nov  78 

Feb  81 

2.3 

TRIDENT  I 

Jan  77 

Sep  79 

Oct  79 

0.1 

MEDIAN 

0.9 

MEAN 

0.9 

‘Start  date,  completion  date  not  indicated  in  SAR. 


C.  COST  GROWTH  PROJECTION  METHODOLOGY 


The  probable  acquisition  cost  of  a  weapon  system  at  ICC 
can  also  be  projected  from  current  SAR  data  using  a  relatively 
simple  five-step  methodology.  The  methodology  can  be  applied 
to  project  both  development  phase  cost  growth  (i.e.,  RDTiZ 
funds)  and  investment  phase  cost  growth  (i.e.,  procurement 
funds).  We  retain  the  same  four  weapon  system  categories;  how¬ 
ever,  different  median  cost  growth  factors  must  be  used  (see 
Tables  3  and  4),  depending  upon  which  phase  of  the  acquisition 
cycle  is  being  evaluated.  The  analyst  will  then  be  required 
to  work  through  the  following  steps  to  develop  a  projection  of 
either  probable  development  cost  growth  or  procurement  unit 
cost  growth: 

Step  1.  Plot  the  estimated  costs  from  Development  esti¬ 
mate  to  Current  Estimate  on  semi-logarithmic 
scales. 

Step  2.  Add  a  vertical  line  to  the  graph  that  depicts 
the  projected  IOC  date  developed  in  accordance 
with  the  methodology  described  in  Section  C. 

Step  3.  Review  the  cost  curves  of  analogous  weapon 
systems . 

Step  A.  Subjectively  evaluate  all  pertinent  data. 

Step  5-  Extend  a  projection  from  the  Current  Estimate 
plot  (‘Step  1)  to  the  projected  IOC  date  line. 

Step  4  is  where  the  analyst  earns  his  money — a  subjective 
evaluation  of  all  available  data  must  be  made.  Depending 
upon  how  one  evaluates  the  program,  make  a  straight  line  or 
curvilinear  projection  (Step  5)  from  the  Current  Estimate  plot 
to  the  projected  IOC  date. 

Let  us  now  return  to  our  missile  system  example  to  see 
how  the  methodology  works.  For  simplicity,  we  will  limit  our 
description  to  the  procedures  that  would  be  used  to  project  the 
Procurement  Unit  Cost  at  the  projected  IOC  date.  Figure  19 
contains  a  series  of  sketches  which  summarize  the  steps  we 
would  take. 


ESTIMATED  PROCUREMENT 


EXAMPLE  (continued):  Assume  that  the  Procurement  Unit 
Post  has  been  increasing  over  time  with  costs  estimated 
as  follows:  $.lpM  in  ?Y  78  constant  dollars  at  the  time 
of  DE  approval,  $.155M  after  one  year,  $.l5pM  after  two, 
3.135M  after  three  and  $ . 19M  after  four  years  (the  Curren 
Estimate).  These  cost  estimates  are  plotted  on  semi- 
logarithmic  scales  (Step  1).  We  add  the  projected  IOC 
date  line  derived  earlier  to  the  chart  at  Step  2.  The 
PUC  growth  curves  of  other  missile  programs  (Fig.  14)  are 
then  reviewed  (Step  3).  At  Step  4  we  subjectively  evalu¬ 
ate  all  available  data.  Using  the  first  set  of  equations 
on  page  37,  we  calculate  that  the  cumulative  average 
growth  factor  over  the  four  years  to  date  has  been 


1.061  (or  6.1  percent  per  year).  We  note  that 


this  growth  is  somewhat  lower  than  the  median  (1.071) 
and  mean  (1.086)  cumulative  average  growth  factors  for 
the  missile  programs  of  Table  4.  As  noted  in  Section 
IV. F. ,  the  procurement  unit  cost  curves  for  missiles 
(Fig.  14)  approximate  straight  lines.1  Accordingly, 
lacking  any  unusual  program  information,  we  would  con¬ 
tinue  the  PUC  growth  trend  of  6.1  percent  per  year, 
which  would  result  in  a  projected  PUC  at  IOC  of 

(1.061)3'25  x  0.19  =  $0 . 23M  (Step  5). 


‘Note  in  Section  IV. F.  that  for  sane  categories,  the  shape  of  the  cost 
growth  curves  tends  toward  concavity.  In  projecting  future  cost  growth 
for  these  categories,  the  analyst  should  consider  use  of  a  concave  pro¬ 
jection. 
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D.  SUMMARY 


Cost  growth  in  major  (and  non-major)  weapon  system  acqui¬ 
sition  programs  continues  to  be  of  vital  concern  to  the  Congress 
and  key  decisionmakers  within  the  Department  of  Defense.  The 
capability  of  projecting  probable  future  growth  in  a  specific 
program  is  a  necessary  tool  for  effective  acquisition  manage¬ 
ment.  This  paper  describes  the  development  of  a  relatively 
simple  methodology  for  projecting  schedule  and  cost  growth  in 
a  weapon  system  program  and  its  application  to  a  hypothetical 
weapon  system.  The  schedule  and  cost  growth  projection  method¬ 
ology  outlined  in  this  paper  is  recommended  for  use  in  IDA 
evaluations  of  weapon  system  development  programs.  It  could 
also  be  of  value  to  other  agencies/elements  of  the  DoD  cost 
analysis  community. 
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